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Description 

i^2,,„ Thte '? Vent) ° n rel6te9 10 8 **» <*nver- 
«ton^Jpment and a method fcitt*SSM^n»£. . 

nwmin data conversion. up^nye^(on^roonveZ 

slon signal with high, resolution and so on 

JS5L ^ are S^^By two wnds of systems for 

^ri n9a8,9na,w ^ erew ' rttonbw shvTh^ 

?P«?.to the space or time or a signal having a laroe 
The other is a system tor convertlng^> n the contrarv r a 

J^Wbiwatton amount. For example, improperly so 
JSEESf 5 **» elernentlntormatlon^mo u n , ; 
olutten pan be.easiy formed , x V-*»?*»r»we 

down converter to, for instance/convert a video stan,* * 

stendard definition (SD) system. Various kinds of tech- 
niques have already been proposed 

in wnteh an electronic zooming process is e^VtoA; 

Viacteblnteipolatedby uslngan Interpolation filter and as 
the Interpolated Information Is used 

SSL^h 8 ?' an0ther W***r« is a sub-slm- - 
^method for periodica^ thinning out pixel data In * 

amltU° mPreSS a ^'^"smlsslon data 
tmr^ltting system la limited. In this case; the Images' 

ng §,de by usrng an^ IrrterpblatidW fiiter,i '••«,■ ™;„, . 

SI?! ^^f^^^P^trWtheresolution" ' ' 
2£5F? Pteture-from obtained bt the inteipolS ' 
with a filter Is degraded. For example even If «HrW 

22":? present 'n;ani!nput SD signal is not ^ 

?f P resent ,nven «on Is concerned with pro- 
SSL? ata convere,on I**"* and • ££' 

[0O09J Variousaspectsandfeaturesoftnepresentin'"" 55 
vemton are defined m the appended calms " 
[0010) According to one embodiment of the present 



meSnsTbr analysing plural Input data and perform: 
\ng clustering depending on a distribution state ol 
the plural input data; ■ j-.y - ■ 
means tor generating; class dateiassoelated with 

Input data andiknowh outputidata- -k. ... . 
memory means for storing the class data at an ad- 
dress correspondlng:to:th(»rcla8s;,r?'r - 
■^^f^ 1 S!jmxm4» data atanad- 

to clustering based on thepmrn) 

K ^ a ^9 enera tlngmeansforgeneratl^ouiput 

^m»™ ^b^menu^f the 
version method, comprising:; ~ • ^ ' ;* v - 

of hep urai^nputdata.generatingclass dataasso- 
elated with im^^ Av^i^^v.^^ ^? ™?. a ? so 




45 



» — ™ «aia ana ine output dfltA ' 

, ^S SS 5 8taa,an e^re^ofmemernbry corre- 
spondtng to the class: and v - ■ " ■■ -■> 
•JJP-for gen ^^date^^lhe ^ 

JWMT Jhe invention will now be more particularly de- 

^•bywayoflllusb^tivearrinon.limidnge^te 
with reference to the accompanying drawings in which 

Fig. 1 Is a schematic block diagram of a transmis- 
sion system to which the Invention can be applied- 
Rg. 2 Is a<echematlc diagram showing a position 
' .- . /relahpn^f picture elements; 

-S !? - a ^ l6ckdla9ram e'ene example of a struc 
tare tor generating a mapping table- 

2 '1 18 8 bl0Ck (,,?9ram of anothe '' «W"Pto of a 
fS re .! or generating a mapping table; 

M* a block *Bnm of anotherem'bodlment- 
Fig. 6 : is I I schematic diagram showing a position 

m 7 Is a block diagram of .one example of a struc- 
tore for generating a mapping table. ' 



2?1" HB ; aundar . one.embodiment.of this. invention 
Z^y*"™"- " n "' S 008 «*odh«t transmits 
pSZr* 1 ! ^^Produces a thinned 
Picture element onthe reception side. Fig. 1 showssuch 
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a transmission system as a yimole. .jn, j Rg..1.;f|rtGrehoB 
numeral ite an Input terminal for digital vl^o^ta.to 
bg,TOn?m!tte(i. j 



pur; ^<»^.^mite8$®^&&£ 

dl&dieub?. ar^.ii;i^«rtS!^#»;^^.t- 5 
'arrlttot.to^^ 

toVhalf.. .,. : i v , v. on ' • .?j;u>ri;^ril^^ TlQ 

plledMe^ 
li^ident^ 

Range Adaptl^typaG^ 

kn&rvcan^ : 
irnpirt [^m^Bfi^ reduce^v^ c , ^ « 
[0016] Theoiitpi*^ 

tra^i^on,proces,ing circuit 4 The transmission 

prqc^l^^ 
w^on } <^ngl>ram 

fransmlssi™^ 

sioifdtols'th^^ - 
slpn UhW 6 is limited^ (a aimmu nk?allorv llp|tan^fe- 
cl^^proces^^ magnet^^^gkan^ r^rqdupr 

$17] /Reception data 1st edthrpugljian Input ^terminal 
£ to a r^ti^ * 
proving ci^it a 

coding otchannelcWng anderr 
ror correction The output of ^e r^eptlon ; p rocking 
circuit tyaglventoadecoder? f-or hlghlY^fflcjentcq^ngj 
The? decked, ot^put of r ihe 1^8^^M^W0^M 9 * 

sefcK^dr^ 

[0018] Thesimuhaneous^^ 11 . as shown 

tlonsanc^ 40 
plctu^ei^ 
culMS'^nd^ 
stmultene^& 

1 2.' lief; class inf omiatldn Is given to a memory 1 3 as jn 
address. signal, / •• •>•-. i ■;■ «Ji2fc! 

[0019] A mapping -iBblel^Kj^^iWnl^iXt 0 ^^ '° 
a manner mentioned later 

In this e^ple,a R!«^? BSWt- 

Bters fe stored Lin trie memory 13. A parameter read out 

frqmanadi^ 50 
clustering circuit 12 is supplied to the inter^olatlon^ata 
generating circuit. The frterpplation^data generating cir- 
cuit 1 4 provides Interpolation data x by the calculation of : 
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x =w1 a+w2b+ w3c+ W4d' : 
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uslng transmlsslon picture^ element data a, b, c, and d 



fromthe strnultaneous ^outptrt circuity 11 ; apd parameters 
ml^^^-iA from th& (woij;'??^,- > c-i 
'jtyD2q. "The Interpol 
leSlng drcuFl O.'fhe seie^ 
put the .decoder 9;When,a tg^g^on^u^ 
is^^ii^teJSe sel^tTr3 v g):jr^fei 0 ;sel&ts Interpol 

14 atia^sJtlor^gt ^ tmnn^ 
quemly;jdec%f^ 

dateis,p^ ISpf ttve eeJLecJjng 

circuit 10 ci -ii ^v'V-'v ^ <j? 1 

$021] Am^m^ 
Islstaredlnit^ 

forming the mapping table In Flg^^^l.vldgg^g- 
nal Is supplied to 21 andto a slmult^eous>utput circuit, 
22 It Is desirable that the digital video signal la a stand- 
ard signal talcln g Int^Va counfrhe generation of a map- 
ping table. For ex^ple/for the^cieo' signal, a signal 
composed of a still picture with various patterns can be 
adopted As sWow^5in^Fi^%e ilrniltaneous output 
circuit 22 supplies a data- memory 23 and a clustering 
circuit 24 simultaneously with data ax* which is a target 
picture element, aritfplc^ c, and 

d, which are present In upper andio^er positions and 
leftandcrightportjons with respect tOjthe date x Jt'&to 
be noted|hat actual value e)d^ 
the ta/get picture element: at the/tlrTie^ 
shown In j^ig , 3 lM; m >J} : ,, <*-^v s \ ^ 
[0022] The clustering circuit 24 % -ca^r^3^»^«r 
tertng picture 

tion as the clustering circuit y of Fig J does; For clus- 
^ng.ijclusterin^ 

etc, can be used r In the use ptslhe^grac^lort^ithe 
number.of, passes becomes, extre^^jlarge If, pk^ 
element da^^h as eight bjtsv^f^sufe lt|le sleslrjable 
that the bit number qf each,plcture ^lernent is reduced 
with hlgbly.efficiency ^dmg;Such : €^i^C0R^'J^n\- 
use. plural patterns ec^ 
(forexarrpie, eyenness.lncre^e^f.a value ini^ 
and u^er;dire(rfon^dec^ rigfit and 

lower direSlon^;)^e f prepare 

^/dne'b^th^plUrai;^ 1 
pq?3]* ^e^utpi^ 
tapneinp^teM 

output of a counter 26 Is supplied to the dhei^.lnpMt.tOk 
mlnal^Sb ^thelewltehlng ; ^ 
generates addresses, which sequentially change, by 
countingclock CK. nTie ^oikput of the switching circuit 25 
is suppU^djo the data m^iy^a.arid-ainempry 28 tor 
parameters ; as their addresses. . 
[0024] /, SanipleyalMes of picture element a, b.Cj d, and 
x areiwrlttemlrup the.data :respe<* to 

addresses which arei class, information. : Fqr exampjei 
(a 1(> a^u, a^J.with resp'ert to the pic^re element 
taa,'(bio. : b 20 ,...,b^).asto 

Cc 10 ; Pao Cho with respect to the picture element data 

c, andGd, 0l ..<W-... *W as tothe picture element data 
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d are stored In a certain address ADO'"^ 

ory 23. As forbther addresses ffbm meciusteftnQ clrciih 

24, picture element data iVatored ln^ 



llarty. 



[0025] Next; the switching circuit 25 te s^tehed^m 
the jnputtenfiinal 25a te25t>; ^indthewntent of tlie ifeta 
me™ti*3is^ 
tKSc^rvter 2^f fie fead^^ 
supplied fo ^eri^ 

vmi this mlhlm^^quare m^Sfj^ra^lSfe 
w1 to w4 are obtalned wlth mlnirpum error. r .^1- 
[00?6] %l^att^ t^f^j 
loviSnfl slmuftianedus equations 'are l&abllsHed With re- 
spect to misaddress f;*' ? r ?. - * 

: r- xl = wtaj w3c1 + w4d1^ i? 



dMder 35 (quotlehtrbecbmes Input ^data of ; the "date 
memory30. f u ^'* ' y " * ^ f 

[0032] Inmeabove^entidnedstiiK^re-ot^ 
tatt Mjrec# 
6te£or^h#ga^^ 

to 1 , :s!r^%eV^S Mptl <^^»f^30^a3i 
w-c.aVYhi;^ tit s^&ss^^^ 

I 

to i^ 

^qMency, 2 ,te written IhWe 



M^tt^^r 

* "iftfri^svJ 



xn = wl en + : ^2bn> w3cn + w4dn 



j we 



[0027] NoW, sinoe x1 to^xn, ai to ah, b1 to bhfcl tb 
cn> and dl to dri ari£ khowrt ln advan<^; the parameters 
w1 to w4 ere obtained sd that thk squared tK& etrorfor 
x1 to xn (actual values) is minimised. ^iif^fiSB^h- 
er addresses " f«s ^: 

[0028] The parameters w1 to w4 c*tairied at i^e arith- 
metic circuit 27 are written into a memory 28: Attapping 
table whteh*has been wrtttert Into m# memory >28 Is 
stored in the memory 13 cf Fig 1 ThereforeV the value 
°* 

the inteirpolatioh ? data generating circuit 14 usin^ 

rameters produced from the^rifiemon/13 c ■ ^ ;■?,- [ 

[0029]= vForthe^mappingte^notoril^ 

ed parameters but alsa^ data 

^'"a 8 ^emselvM^re^provided n^ be employed In 

this M^; : the1hteipdlatibn^ 

Rg i Mn beomitted^ng ^show 

Ingthe mapping tabled Sfrnilarly 16 tfie strtiSiire^df ? Fig 

3, plural picture element data Vrih^^b^Miiiilyrte' 

supplied fo me dust^ 

plied tb a data' memory 30 and aVreqi/ehcy memory 31 
as an address ' " ><• > . ■■ . 

[0030] The read-out output of me frequency memory 
31 is give to iahiadder ^ 32 an^added by *1: The output 
of me adder 32 Is written into me^samb address" of the 
memory 31 ; For the memories :3d>and 31; each content 
of their addresses is cleared at zero as me initial stage. 
[0031]. - Dat^read from'meo^ta memon/ 3^ is supplied 
to a multiplier 33 and muJtiplied b^ 
read outof the f reqiiericy ; memory 31 l . The 6utput v 6f the 
multiplier 33 is given to an adder 34 and added to the 
Input data x there. The output of the adder 34 f Is supplied 
to a divider 35 as a dh/idend.Td me divider 35, the output 
of the adder 32 is fed as *a divisor. The output of me 



20 



25 



ai.uiqi uirio-K> ouipui wnen^a Clffi 

ot^utbr^ciu^ 
halp«elem^atS6f^1^ 

n^i^fp^ 
cbVn^S^ • 




?-slglSaii:i«^ Stfvicleb signaiiis sup- 

plled to' a terming lhcflcate ; d at 4^ ^ajripleVof the^sb 
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simultaneous output dhiairt42VhbsSbi^ 
plied to (Siistenng circuit 43 'Thebutput of theclustenng 
drcult43;is^rit i as ! a^ . 
to 44clw^ere mapping tables' M1> to M4 are stored 
(0035] Fig '6 partially showsa relatibf^lp'betvveeh a 
SD picture and'a^ND plcfure ' In Rg 6* pteiui^element 
data by clreles O belongs ttftlie SD^tufe^lle pictufe 
element data" indicatedby CTOsseis'Xibelbngsto tfiaND 
ptcture Fbr example Mfplctureeieme'nfda^iyl to V4 




45 



thernem^-44av|8fcr i geH 

generating picture%lemenldatay2/ ahdW resbec^ 
Uveiy! T^^^M^r { v v^ irf^^^v^^^; 1 , ^ -::r 

[0038] The read-out outputs of me memories'; 44aHb 
44d are given tfa seizor 45^The'select6r 45 Ist^n- 
tro|leaby:th"ebi^ikd 
cult 46! Appling y 

from ah inpiit terminal 47 to the selBctio ^n - signal ' gener- 
50 ating circuit 46 The four picture element diata y 1 to y4 
is ^selected 1 s^uehu^ly by bie selector 45 and Is sup- 
plied t6 5 a scanning w 

cdnvereldn circuit 48 generates p^tire'Wl^ft d^a ol 
the ND picture In the order of raster scanning at an out- 
put terminal 49. A r monitor for^ND is connected to me 
output terminal 49 through a D/A converter (not shown). 
The number of picture elements of an output picture Is 
four times that of picture elements of ah Input SD video 
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signal.,..,, .... .. .. •< •,.,« ■■•■■■fa rpoifrt*' . 

[O037i Vfla.OWf <>P e e^mp^ta < stn0ij]p for 
cSrteratlng the mapping tables M1 'to Mf storedjjn the 
memories 44a to 44d. In Fig. 7, a digital ND video signal 
is.suppjed...^^ 

HDVTR. a HD video signal can be.provlded- <!? 

filen ent data ato • 

Fig.:|S^^r^terr)e| 



ci^n^^ 



generating circuits 5Aa tO;54^.,, ; i-,. . ra .. <a \a .>: . »■•• 
[00391" The plcture^element datayl to y4 Is supplied 
to the rhapplng table ■ms^Ml^^SMS^f 9 ' 

^ i fk'A Aai» ^Af Mamfl nn nn tab e 'OdnerBu no cir- 



wmpariyln^d^^^^ 

that various changes and modifications may be effected 

thj^nj^x^g^al^l^jin the, art. . . , : . . 



Claims 



to ; 54d,ln tl&ca^ , : . 

c#«&*!^ 

oltt&lafe^^ 

aWltlpi^v^ - 

ft»,fe|*S!k^frv->a sir w « ^'^^caw^; t 
rowf Mapping tables s^09#?^»^ be - 
tween the HD video signal arid the SD video signal are 
etdHKi;ta^ H 

plfjMfe * 

[OTiyi^oughfirte^abov^ 

merit i£an,e^ptewh%e th8 4 up^nv8relpn of the SD 

vide* slgriaf b-the )0.yidi^'-i«*#i»?«*«***« WM * 
ttoncafl^appAied similar^ 43 

[0042j' With the ab^ 

with a thlnrilng-put system can be received, and a 
thinned picture element can be.imeroolated without the 
deterioration tf/i^sm-Wm&^tiWS®^ * 
lacWrigatiheime oT^w^leM^e^SJ^^. In " 
temoiateU'lhelnvention Is applicable In a similar man- 
ner. Also, the above arrangement nj&ohjy penflfeayd, 
9oiinSwJui.8tan^ 

resplutipn to beidispiayed on.aimonjb« 0 ; ^ <■>..■ ■ 
ments of the present Invention with reference to the ac- 



of.,the,flrs^ 
' comprising,. 4 - ^ „•"; .rut- 

:ilng%a^ lm ; 
, - ^i^lgrial^d^ecorid: ^feBm|ng;imSge signals 

corresppftij^^ 

determining means (24) tor determining a class 

7 : : f ; ^;Ae ; Rlxe!(x^f the:sea£d Iep)n5 iJ?3?S? 6| 9" 
nals; producing.means j(2^fpr,prpducjng tfie 
parameters (w1 w2. w3. w4> for each of a plu- 

.... . . ralltfcpf^^^ 

■ . ; nal^and th e.pb^ls ®mW$&^ } " m * 
, 4nglmagej^ . 
memory means (28) for storing^ ^parameters 
, ; ^ <W.m>W& ^ tP^?ft^ ^P^rftl^ot class- 



2,' s A learnlng^p^ratue^^^ 

^s.by:soNlr}giequations>fpr mlnlnr}felng<tlie square 
V> ot,thee^rs>r^ 

a. ul A learning.ap^ratig^ 

■rsald determining means;(^) c^em^esa^asstor 

, a/p^W^fe 
^ll^edo^f^em^ 
firatteeJTilng.lma^ , : n , 

4. A learning apparatus accprdin 

J r ^Id^etermlnlrig, mfiarw ^C^>«.4flSA!!! n ! v 9 6 ' a 
' ^cjass- for^a 'pbcei; (x);of 5 the^secpnd learning image 
signals based on a gradation of Ihe group^of pixels 
(a-d) of the first learning Image signals. 
• «w)iW r c s C» ji-y ^rtruU^-i\ 3* 
5.. *j A method f prtje^ingpE^rte.ES, (wl h w2| w3 r :w4) 
used for, conyerting r aifirst image^nal.jri^^sec. 
ond image signal try forming all pbcels of the second 
Image, signal In accord^jWlth.plxels.pf the first 
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'StQpS Of P * ''' * : * * ' " - 

outputtlng (22) fl^aml^^&^W^: 
responding to the first Image signal and second 
learning Image signals corresponding to the 
second image signal, 

«xe! (x) of the 

second: earn fow irnanS f eitf££tt e&'ttx^'t—j 




to 



for each of a plurality of classes ba^'upbn the 
Pixelsiialrdl,..:, , anniJn), of the first 
:^^^ag^!gn«^p^^l-xn) of 



resolution intg'a^otfdft^^ 




■ age.adja<sentttf^ t . ...... „_ I(> a H1AW U( ine 

second Image Is to be^liSerecfc character- so 

' Ised by^ ' ■ • > ^ W .v,-. , 

1 nS^-^ c»hsldered/plxel for 

pixels of the second Image signal In accord- 

ance -Mrfth. predicted value for the considered 

f pixel coritelhacl i^^b^thtfm^/ion^ ss 
tain nd foKea^ a nil ii^irnj Af hi^^m^.. 




U n ' " vv .T-rV^T^v^^'i niemorycontaining 

- ^ssed lri'aa^ance>^^SS « ^S^^S^^W^^^ 
— .ythe^nln^eane^ 0 " ^ m^^^^^m^ 

. ^.nVmeamcbVn&esa^^r i*? 

with the classification determined by the determin- 
ing means; the meriibriespro'ducing 
dlcted'plxels.-and means for suppiying'thecorisld- so 
; ered pixels to an output In a predetermined se- 
•" qiience.- s , ->«-"-»- • 

8 *., '^P pa / a - u ? ^o^'ng to claim 6 or 7, wherein the 

' ' ^ j^ge v SgniiM5;b|-8t^claid definition arid the" » 
second image signal ts of high 'definition:- ''■ "• 

9/ ; Apparatus v euxording to "any of claims 6/7 or 8, 



. ^ Mvw.uu.y w worn 1 1 ; or iz^wnerein the 

first Image signal Is of Standard definition^ the 
second Image signal (elof high definition^ : *^ 



14 .Apparatus According to clairh 1112 or 13 c wherein : 
the first Image signal Is a signal Which some pixels : 
are fnteroolated tmnrv W im^n **~i*~ t 



1&;#metfiM wherein 
''group of pixels of the* f l^m^S^^^^fie^:' 



6 



16. Apparatus or method according to any oT claims 1 1 
to 16, wherein the predicted values are produced 
by training apparatus comprising: 

means for determining the classification by pic- 5 
ture content of a group of pixels of a reference 
Image, the group belngadjacent to a target pix- 
el of the reference image, the target pbcel cor- 
responding to a pixel to be considered, the^ 
group corresponding to pixels of an image hav- io . 
Ing first resolution, the group together with |he ' 
target pixels corresponding to pixels of aii¥n- 1 I 
age having second resolution higher than p\e j 
first, and I 
means for deriving for each da^slflcatlon:^^:\^t 5 ! 
dieted value for the considered pixel from; at) &\ j? 
least the values of the target pixel. f'- 4? X> f 

17. Apparatus or method according tojeiaim i6 f .where-|- 
In the deriving means comprises a ^mear^|or count- 20 t 
Ing the number of occurrence of e^h eta '-" 
and means responsive to th e counted- number f ofc* 
calculating the average valup of {retarget pixel fo^...~,.j 

I each classification as the predicted y^Jcr ; t^ 

considered pixels. f . -&f r f 2 ? 

£. \ . \ 

; vm- f •• v- j 

18. Apparatus or method accordlngtoany one of claims 
6 to 15, wherein the predicted values are produced ji, 

.'• by a training method comprising q ■ 

determining the dasslflcatlpn by plctui^cpn-U^O; 
tent of a group of pixels of a reference mage, the ^ j 
group being adjacent to a target) pixel of the refer- 'f\ \ 
ence Image, the target plxe|wrres^dln^o^ ! *. 
el to be considered, the grpyp cohii^m^^j^^ ; 
els of an image having first resolutio^the grcuipto^^^s 
getherwlthtte target pixels|cor^^ j 
of an image having second resolufloh higher thart^ , 
the first, and " f' ;ff C:.;!-^ • 

deriving for each da&lf^tfito ^iSMeSyi^ 
ue for a considered pixel fromat least me values of^ -w 
the target pixel. [; fl.^J {. 



rf v 



19. Apparatus or method according tpjclaim 18, where- 
in the deriving step L»^„.f- f 

comprises a counting, the number of joccur- 
rence of each classification an^cllculating j p. 

the average value of; the target pbcel for each i 
classification as the predlbted^value for a consid- 
ered pixel using the counted riiiornber. 

;■ ... so 
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